Shipping to Learn
You're coming up on the end of your first day here at Toggle Outfitters and let's just say, the right people are noticing the work you've been doing.
All you do is win 🎊​
Thanks to your efforts in our Goggles Worldwide program, we're now crushing the goggles market globally and we've gone on to acquire Goggles Outfitters, making us the largest global distributor of goggles this side of the moon.
As you guessed, the work never stops here at Toggle Outfitters, success seems to breed more success and no sooner did we get through with the goggles launch, than we saw an interesting trend and we've decided we need to learn more.
Challenges 📈​
Our estimates for the goggles market seem to have been good, but our goggle sales are way outpacing our toggles now, which is great, but it's beyond our market estimates. We have the best data analytics team around, they're never wrong, so there's some X factor that is driving goggle sales higher than expected.
Our marketing team has developed a hypothesis that it's the fancy "NEW" label we've put on those goggles that's sending our goggles sales higher. At first they wanted to just add that banner to everything and see if it helped, but we convinced them that probably wouldn't work if we just always labeled every product as new. Some of the sheen comes off a special if it's not all that special anymore.
Once we talked them down from calling everything "NEW" all the time, they came up with a more refined strategy.
We think that "NEW" seemed to drive a lot of sales, but in some market research, we found that "SALE" and "SPECIAL" resonated very positively and could work as well or better.
Remembering your beach-side conversation in Lisbon, you started wondering if we could somehow incorporate data into this process. Instead of just trying these out YOLO-style and trying to decipher which was best, we can experiment as part of our software delivery bag of wonders (aka LaunchDarkly). The entire marketing team broke into a nervous sweat when they thought that meant a new tool, procurement, and a steep learning curve.
Fortunately, LaunchDarkly feature flags support experimentation right out of the box. We can experiment on any feature flag to learn from every release!
Experimentation 🧫​
Lots of folks call experimentation by another name "A/B Testing", but with LaunchDarkly, it's more like "A/B/n Testing" because we're not limited to two variations.
Experimentation, deciding how to show different variations, measure the impact of those changes, and pick a winner is no small feat. It's hard to begin to think of how we'd work out the code to distribute the variations, capture who saw which variation, and then tally the results to figure out what to do.
Luckily, we've got our secret weapon, our new hire who is absolutely crushing their first day here at Toggle Outfitters.
Your Mission 🔥​
Launch an experiment to determine which featured product label is the most effective at driving customers to decide to purchase and drive real-world sales too, because we actually have to sell more of these things if this is going to work!